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ONE GOOD REASON VniY ORlEMTItJG DIRECTION'S WOJ/T HELP LEARIdllG 

ABSTRACT 

A recent reviex; of the literature^ dealing with Lhe effects of pre- 
senting instructional objectives on learninc^ M .nined that objectives 
failed to raise learning in about half the e>:perinonts. The interpreta- 
tion for the failures exclusively relied on a theoretical analysis of 
problems v/ith the technique. Aii alternative analysis, and supporting 
experimental evidence, suggests that objectives may fail precisely be- 
cause certain instructional materials carry implicit objectives which 
experienced students can recognize, thereby rendering statements of 
objectives superfluous. It is suggested that researchers in this area 
collect data reflecting test expectancies and stu^V activities of 
control subjects. 
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ONE GOOD REASON WllY OratSfflKG DIRECTIONS UON'T HELP LEARIftriG 



\Hiat procedures uhould teachGts follow to reliably enhance designated 
student achicvuiiiCiic; ^••c rather obvious .ethod \;ould be telling the 
students in precise terms ;^iat their tests will contain. Indeed, Miles, 
Kibler, & Pettigrcw (1967) found that students who were given the sterns of 
their multiple-choice test items, as instructional material, significantly out- 
performed those who were given only a list of generally specified topics, 
Wiere test behavior is itself a valued outcome, teaching the test may 
have merit. However, where a test can only sample from the domain of 
criterion behaviors, as vzhen learning outcomes coastitute skill in 
applying principles and solving problems or when time available for testing 
is too limited, then teaching the test may inappropriately confine 
learning to the test alone. Furthermore, where test performance falls 
within the lcnov;ledge domain, providing students with test items as 
instruction may lead to rote associative learning devoid of understrjiding. 

Conceptually related to providing test items for instruction is the 
technique of providing descriptions of learning outcomes, that is, 
stating instructional objectives. Logically, test items represent one 
end of a dimension of test cues or "orienting stimuli" as teirmed by 
Frase (1970), The wording of instructional objectives may be varied 
along this dimension from a degree of precision that achieves a compre- 
hensive, detailed characterization of test performance (test questions 
and ansT^ers) to a vague exhortation to study unspecified materials for 
a test of an w \ oified character. Perhaps surprisingly, a recent 
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rcvicw of the literature on the effects of providing students with 
relatively precir;e statements of instructional objectives detemincd 
that this technique failed to raise ach:''evr-^ nt about as often as it 
helped (Duchastel 6 Merrill, 1973), In an effort to uncover an explana- 
tion for the unreliable effects of staled objectives, I>ichastel and 
Merrill classified experiments according to: 1, subject matter or 
type of learning; 2. level of schooling; 3, duration of experimental 
treatments; 4, degree of student control over preparation time; and 5. 
interactions bet\^een the use of objectives and individual differences. 
However, only^ the last variable \*us found to be related to learning, 
and factor could only be applied to a fer^r of the studies reviewed by 

thtoi, 

Duchastel and Merrill also suggested possible problems ^ith the use 
of objectives that might account for the lack of significant effects 
in past research: !• subjects might not have used the objectives be- 
cause thay did not realize their connection with the test; 2, objectives 
may be dimensionally complex (hence potentially ambiguous to students); 
the particul ir dimension-- specificity-- may not parallel the beliavioral- 
nonbehavioral dimension (hence certain othen^ise specific objectives 
may not have provided unambiguous description of criterion behf^viors); 
3, objectives may have been too extensive both in mmiber and detail. 
This problem list exclusively attributes the failure of objectives as 
aids to learning to the objectives themselves, but an alternative 
explanation is possible. 
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It is nGCGs,«5ary thnt two clcuTCntary asciinptions be realized before 
one can logicaHy derive a prediction that presenting objectives to students 
will raise learning: 1) Stated objectives ntist induce tost preparatory 
behaviors different in hind and/o/ degree from beliaviors engaged in by 
students receiving other treatments; 2) The distinct preparatory behaviors 
so induced must '^rovide higher positive transfer to outcone testing than 
control preparation. In conventional research on uhe effects of 
objectives, the validity of the first assumption , has been presupposed, 
while the second has been directly tested as the experimental hypothesis. 
Failure to achieve statistically significant treatment differences has 
rather automatically led researchers to examine the objectives to 
determine hew they x;ere inadequate.. However, it is possible, even 
probable in certain instructional contexts, that non-significant 
differences resulted from a failure of the first assumption. 

Such a circumstance would occur \^en the tested outcomes are 
anticipated by the control students who, thereby, generate appropriate 
objectives for themselves. Instruction that has been designed 
effectively at the outset v;ill implicitly, if not explicitly, help 
students to discriminate important from relatively unimportant, if 
supportive, (Retails and concepts, and will induce students to practice 
essential skills • In this case, objectives may fail not because ^'hey 
are ignored, or because they are ambiguous, but richer because effective 
instructional materials have rendered them superfluous. 

The experiment reported here is unusual in that the veracity of the 

J 

first assumption was examined concurrently with a comparative test of 
a variety of orienting directions. Specifically tested in the context 
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of a lesson about child development read by Kd, Pnych, students were: 
a.) general directions to learn the identity of researchers according to 
the characteristics of their research and findings; and/or to learn 
dcvel<*pniental principles and concepts; b.) to learn the above information 
by formulating and writing notes; c.) to study by answ ering inserted 
question:; covering the information described above; d.) by studyinR 
without benefit of explicit orienting di'^'cctions . All students were 
informed before studying that they would be given a f ill«in-the-blank 
test. Half of the testable informatic:: was represented as inserted 
questions, which -^ere repeated on the criterion test; the other half 
consisted of items that had not been inserted (items were chosen 
randomly from the pool for insertion). The inserted post question 
procedure in dominant use was modified to allow students to review 
their text after attempting answers (based on Hiller, 1973), 

EDCPERIMC^rr I 

METHOD 

Materials 

Tlie lesson was based on a 2265 word lecture, prepared by the in- 
vestigator, that described concepts and principles of child development 
and in each instance specifically described the implications for 
educational practice. Researchers and theorists were identified for 
their contributions, and their research vras described and linked to 
the developmental principles. The lesson was presented as a six page 
text with 350 to 400 words per page. 
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Each pace proncntcu two principles and idintificd two researchers 
except that one paye mentioned three names and another page three principles. 
Tlic test contained tvelve n»anie and twelve concept items which took the 
form of verbatim or paraphrase descriptions of research and characterizations 
of the principles; the student's task was to fill in the names of the 
researchers and t^rinciples vhich had been deleted from the test itrms. 
Half of the 12 name and half of the 12 concept items v;erc randomly selected 
for use as inserted post questions, and these items wero. also included in 
the retention test. 

Participants 

Participants were 162 students who were fulfilling a requirement of 
their undergraduate Educational Psychology course. 

Treatments 

Nino treatment conditions were instituted as follov7s: 

1. Control. Students were directed to study according to their 
individual habits and preference, thus permitting note \7riting and underlin- 
ing; this freedom to excercise unrestricted use of pre-existing study skills 
( see lliller ,1973) is denoted below as "Free." The only orientation given 
to this group was the first statement of the text, common to all lessons: 
"We'll first consider certain facts about human motor development and then 
form a theoretical perspective about the nature of maturation and its 
implications for education." 

2. Inserted Questions for names and terms, Restricted. After eacli 
page of text, a page containing one name and one concept question was 
inserted in the lesson. All students having inserted question treatments were 
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ptovidcd with dr.roctiono on tlioir use. Tlic qiicntionn were described an 
"cttidy aids" or •'check points'' to enable the ntudonl to check hav veil 
he was doing. Ihe student was directed to study ench page until he felt 
confident of his ability to an.wer a que';ticn(s) on its contents. It 
was stated that looking aliead to see \;hat the q\:ostion vould be would 
defeat tlie method and invalidate the results. However, after writing 
the best answer he could think of (with the restriction that he not erase), 
the student was permitted to revie,^ freely, Tliis treatnent required that 
the student not mark his lesson nor take notes clsc\;here to enable a test 
of the effects produced by this form of "Restricted'* study activity. 

3. Inserted Questions for nrjnes and terms, Free Study. Treatment 
directions employed hero were the sane as for ir2 above, except that thn 
students were given the same direction to study according to habit or 
preference that x^as given to the control group. 

4. Instructional objectives for names and terms. Free Study. The 
following two objectives were described in the lesson page preceding the 
text: '*To do your best on the test, you should be especially prepared to 
identify the developmental trends described aid to provide technical 
terms for their definitions." A comparable objective was presented for 
names which required naming of the researcher "according to the research he 
performed or his findings." 

5. Note writing for names and terms. The student was directed to 
mentally compose a short description of each researcher's study and its 
finding (s) and then to write this with the name on the back side of the source 
page; this procedure was designed to test the effect of enforced encoding. A 

comparable instruction was presented for writing the definition or 
description of each developmental concept. 

6. Inserted question for names, Restricted Study. 



7. fnctructlonal objectives for ntino^, Free study. 

8. ]n -verted questions for terns, Rcntrlcted study. 

9. Inntructional objectives for terms, Tree study. 

P rocedures 

Students were randomly assigned to one of nine areas in a large lec- 
ture hall as they arrived at the session. Each student was given one of 
the lesson booklets and instructed to wait for directions. All lessons 
had a common cover sheet tliat first explained the experiment's purpose: 
"to test the relative effectiveness of different methods of studying for 
e:caminaLions." Next the cover infoxrraed then that they would take 30 
minutes to study a lesson of about 2000 words, then fill out a brief 
questionnaire asking for opinions about the lesson and experimental study 
technique, aiad lastly take a 15 minute test. Tlie experimenter read the 
directions aloud, and then had the students turn to the second page which 
presented directions for the study techniques. At the top of the 
second page in all booklets V7as a statement v/liich explained that the test 
would require short, fill-in ansx^ers. After all students had completed 
studying directions for the study technique, they were set to work. 

RESULTS 

The lesson was rated as having average readability and ibove average 
interest. Ratings for the value of the study methods were not signif- 
icantly different. Thirty minutes proved to be sufficient study time 
since nearly all students terminated overt study after 20-25 minutes. 
Similarly, most students finished the test after ten minutes; although 
announcing to them that ans\7ers had to be correctly spelled for credit 
was seen to produce added effort. 
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Mean lent pcrforr^ncos for t!ic repeated, inserted question test 
Items (see Tabic I) were significantly different for both names and for 
terras by /CIOVh. pcrfomcd on data to which the Arcsin transform had been 
applied (results \;ere comparable without the transforr,ation). Inserted 
Katnos F (8,1:)3) ^ 10. AC, p < .0001; Inserted Terns F (8,153) ° 6.67, 
p < .OOCl. ::amc items U5cd for the first tinv^ yielded F (8,153) ^ 2.16, 
p < .03; whereas the terra items which hadn't been used failed to 
demonstrate treatment: effects, F (8,153) =* .90. 

Ncwman-Kculs tinalyses ( p <«05) for test items that had been used as 
inserted n^-ima questions sho;:cd the following (Table 2). Groups having practice 
witli the name questions outperformed groups without that practice, except for: 

a.) the group instructed to study only for na-nes ( group 7); and b.) the 
group required to in'ite notes (5). Hie t\i7o groups having combined name and 
term objectives outperformed only the group (9) given the objective for terms. 

Analyses of results for inserted term items (Table 3) sho\7ed that tha 
group which received the instruction to learn both names and terms (4) and 
the group that had inserted name questions (6) both retained significantly 
less^ terms than the three groups \il\o previously saw these questions as 
inserts ( 2,3,6c 8) and the control group (1). 

Tlie relatively low performance by the Terms objective group (9) seemed 
odd, even thougli its retention for inserted term test questions was statist- 
ically inferior only to two of the groups who had seen the questions in 
their lessons (3&8). Tlierefore, an additional group of students (N=ll) 
was run, but their performance was virtually the same ( see results for 
group 10 in Table 1). An abstract possibility existed that the Term 

Insert Tables 1,2, & 3 about here 
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objective v/as somehow ambiguous despite the distinct character of the terms, 
e^g,, cephalocaudal , mass-to-spccific, etc. But inspection of the notes 
written by the group required to take notes on terms (5) sho\7ed that an aver- 
age of 12-4 terms of 13 possible were identified by each student. 

The Newman-Keuls analysis for the name items that had not been used 
as inserts showed only that the instructional objective for names pro- 
duced results superior to inserted questions for terms. 

A final result to note is that overall retention for terms was 
significantly higher than for names (mean percent correct for t\7elve names 
= 11*3; for t^7elve terms = 28.8 and a test for transformed [Arcsin] data 
= 10.0, p < .001). 

EXPERIMENT II 

The first experiment determined that orienting directions did not raise 
learning above control levels for terms but did for names. To enable a test 
of the hypotheses that the intrinsic character of the lesson, and student 
motivation, made directions for term learning superfluous, but directions 
for name learning a necessity, t\7o additional studies were conducted. In 
the first, the names and terms appearing in the lesson were high*«lighted 
and sequentially numbered. Fifteen students v/ere instructed to rate each 
numbered item on a scale from 1-5 for the likelihood that the teacher 
who wrote the lesson represented this information in his test. A rating 
of 2 asserted that it was unlikely for the item to be tested, 3 that the 
-item might . be tested, and 4 that it wjuld probably be testied. The mean 
rating for names was 2.7, whereas the mean foi: terms was 3.5, t^ (14) = 
3.6, p < .01. TIius, students could anticipate testing for term knowledge 
better than for name knowledge, and in an absolute sense, name testing 
vzasn't expected but term testing was. 
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in the second study, the possibility that the names were simply more 
difficult to learn was tested. One group (N = 12) was given the t\^elve 
test items for the names, V7ith the nar^ "illed in and underlined to study. 
A second gr .in'; ■■."^ 1 .-i j signed to the set of term items, and a 
third group (N = 16) was given the combined list vzith the name and term 
items alternating. Participants were randomly assigned to these treat- 
ments at a single session and all v/ere given 15 minutes to study. Given 
the test in its original format, the Name study group averaged 9.00 correct 
for names and 0.0 for the terms, while the Term study group averaged 0.0 
for names and 8.87 for terms. Thus, differential learnability for names 
and terms in the lesson was not a factor. 

It is interesting to observe that the group v/ho studied both Names 
and Tenr.s averaged 2.31 for the Navues, but 4.63 for the Terms, t_ (15) = 
4o83, p < .001; so that this difference x^ould seem to reflect differential 
motivation to learn names vs. terms^ in light of the above results. Indeed, 
a questionnaire given to the 43 students in this study immediately before 
testing, to determine their interest in learning about the identity of 
researchers vs. developmental principles, sho\7ed that the latter was much 
preferred, t^ (42) = 3.2, p < .001 (this result was consistent for all 
three groups) « 



Three points were demonstrated by the results. First, regarding the 



test questions did, in fact, improve immediate retention for those questions. 




DISCUSSION 



well-established principle that practice may help— direct practice with the 
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The inserted post question procedure, modified to accommodate 
revic\^ after each question had been responded to, did nqt improve re- 
tention of incidental information; this finding replicates Gustafson 
and Toole (1970), Killer (1973), and Denzel & Killer (1973). 

Second, although difficulty for learning technical terms 
was equivalent to that for learning researcher's names, term learning 
nearly tripled name learning. Questionnaire data showed that students 
thouglit knowledge of developmental principles, as represented by the 
term learning test items, was considerably more valuable than knowledge 
.of ^ijhich researcher had performed any particular developmental study 
or had discovered any developmental principle. 

Third, and most important, orienting directions did not improve 
learning of developmental principles over control levels-- most likely 
because the controls were able to infer that acquisition of such know- 
ledge was the point of the lesson. Failure of the groups receiving 
instructional objectives for terms to outperform the control cannot be 
attributed to any ambiguity in the objectives, since the group required 
to write notes for terms correctly identified the terms in their notes 
and did not represent any other information by these notes (the same 
accuracy and reliability was also demonstrated for tlie researchers' 
names). In contrast co term learning, orienting directions for re-, 
searchers' names, particularly practice on the name questions, did 
improve performance, but only because control students could not 
very well anticipate name-test-items^ and did not otherwise value this 
knowledge. 
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Had the cxporimcnt been performed only v/ith kno\7ledge of develo[jmental 
principles as the basis for instructional objectives and testing, the con** 
elusion would have been correctly dra\m that the instructional objectives 
were not helpful as aids to learning. And based upon this conclusion, 
the investigator might then have struggled to determine how the stated 
objectives v;ere linguistically ambi^ous or conceptually inadequate^ 
had the experiment not also included the treatment which required students 
to write explicit notes for the terms. On the other hand, exclusive 
experimental focus on objectives concerned with learning the researchers' 
identities would have led to a positive finding for the value of pre- 
senting a general statement of instructional objectives. 

This analysis should not be interpreted to mean that the wording 
and deplojrraent of the term objectives could not have bean improved. 
Rothkopf and Kaplan (1972) found, for example, that learning was improved by 
providing highly specific objectives rather than broad ones, such as the 
two used in the present study. It is quite possible that providing a 
check list of the 12 developmental terms represented in the test would 
have improved learning. 

Based on the pattern of results obtained in this study for name and 
term learning, it would seem that data should be collected in future 
studies to reveal: a«) what material students believe to be worth 
learning; and b) what they expect their tests to cover^ since this infor- 
mation may contribute to an understanding of how orienting directions 
affejct mathemagenic behaviors. 
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Tabl2 2 

Newman-Keuls significance tests (p < ,05) for inserted Name test items' 
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Treatment means which are not significantly different at p < .OS are under li.ned 
by a common line. 
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Table 3 

Newman-Keuls significance tests (p < .05) for inserted Term test items 



TREATMENTS 


I,N+T 


Q,N,R 


I,T 


I,N 


I,N+T,E 


C 


Q,N+T,R 


Q,T,R 


Q,N+T,F 

















































